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NOVELTY - Action controller (12) has a movement control unit for 
controlling movement of robot, whenever a person is detected by a 
detector (2), sound is detected by a detector (7) or when an ultrasonic 
sensor (9) senses an obstruction. A search unit searches person 
information stored in memory (5), to identify the detected person. An 
interactive process unit initiates an audio output device (15), to 
provide response message to speech recognized by a speech recognition 
unit (8), according to the distance of person from the robot. 

DETAILED DESCRIPTION - The movement control unit, person 
information search unit and the interactive process unit of the action 
controller are switched in predefined order by a control switching 
unit. 

USE - Autonomous pet robot. 

ADVANTAGE - As the robot is operated by action controller, in 
response to person detection, sound detection, speech recognition, the 
robot is made user friendly and congeniality of the user is improved. 

DESCRIPTION OF DRAWING (S) - The figure shows the entire block 
diagram of the component of the robot. 
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ABSTRACT 



PROBLEM TO BE SOLVED: To realize a robot enabling a person to feel the 
affinities thereto by obtaining various external informations by storing 
the information on a distance to the detection of a man, and the 
distinguishment of a man on the basis of the input of an image, recognizing 
the sound source direction and the voice on the basis of the input of 
voice, detecting the obstacle and the like by an ultrasonic sensor, and the 
like, and simultaneously executing the optimum processings. 

SOLUTION: An image input device 1 inputs an image of one of cameras of a 
stereo-camera to a man detecting device 2, and inputs the images of both 
cameras to a distance calculating device 3. The man detecting device 2 
detects a man by image processing, and extracts a face area of the man to 
follow up the face area thereafter. A man distinguishing device refers the 
information on an image of the man stored in a man information storing part 
5, and a voice input device 6 consists of three microphones attached to a 
body, and outputs the inputs to a voice source direction detecting device 
7. An obstacle detecting device 10 calculates a distance value to an 
obstacle of every ultrasonic wave sensor 9 and holds the same, and a touch 
sensor 11 distiguishes a rubbed state and a tapped state and outputs the 
same . 
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affi«Sffl#JSfc, 1MBA4Mftffl#*K:J:*«ffl3ftfc 
A»Sr»8Ur<5A««»SU#«fc, A*©««*IE«r* 
A4M*«E«*«i:* m*8ti:, 

Si:, mE*J»A*«»::.fc 5 A*ShfetJ**B»t 
«*FIMII*«i:, SfStyflci; 0JSH0l*84fe$: 

*Hr*ttftM*W*«i:, 1ttlEA»*a#«^J:0*UJ 
S*bfcA1fe*W»»i:«lEA4(5«fcaiJ*B«cj; OttJSU^h 
fcA*«aU*'*fcJWIB*K*fli«UJ¥«»cj: £t£a2h, 
fc#JH#m t MEfiF^rRtt^&tC <fc 5 RflR £ ftfctf jarflj 
fc ffiEiB8«tt tf^lS:*c J: 9 $ ffi £ *tfc|*S«BflMR £ 

n*-* b^ff»4r*jfB-rsfTtb»j«i#ak % mnmmm 

MEA%«ai^«X05MlBA**SU¥«2lI/miE»jR* 

■fir, mEAttfeHJ^flttcJ: 9 A»*5*ffl**Lyt#^*fe 

»*tt&VtcMEttMttH#«tcj: &*«*s*ffl£*,fc 

S4EA*1»«EtS«BlcE«SixTV^A*ft«S:#fill 
U -to»-Cd#-x h4r#jh**, ffiE*R*A4fttt? 

tf, WEA**UJ*«lcj;OA«^5»HiShfc»^4:* 

rsA»«3R*&a«i:* 

mEA*««E«aJ^EtSS*x"CV^^AA««**K 
U P^^y McWEA»*ffl*«ICJ; tlftBLtv^A 

AftS-COSEii^fcfe^cfcftft 6>*L*:ffi<fc 9 < 
**omE»»*tttti*«|cj: t) A»*-roR|^«8*^ 
fcffi£;fttev^£tt:A»^»ifi-U WEJgllt^fc^^c 

J»l»«*«»cj; !3*F*R»bfc^U;Rabfc#Wc 

« fctt#«lc J: 0 ft tt*s«t£H £ ftfc £ £ feixfc**pp 
**HytA*^ J;or»*5*S*S:mEra:*ffl**«»cj; 0 



UWjU fttfEA*S»SU^®lCJ;!9«ttibTVN^A«5Sra 
B'J bfc»-fr^MEA4b««E«^«^E«* v^^>ftfI 
EA»©fl»«LS:#SbTttA*lcjffi:Cfcrti:*5rU ME 

h*5fi»*Hfcfc#lcS9E»»«l»*aaWSrje» 
U tt^»M»toa^^EA*»0i#»lc:j;9A^d s . 

*as*i,fefcae)icHT Lfc»«tcffiEtteaa«is«:jgtt 
u mE»n««PAa«^mE#«^ttu^»ici:9 

#*T b^»-&tmE*«tttil*«lCJ;.Oj|»T b/^-SiC 
A*«SR«ka«4:jB»U ttAwa^aawa^EA* 
Jfcfcb^gttcj; &A%aM£W£fr;fcfc«>la&7 bfc»-&ic 
»B«a»S:fi»U S9EA4*«*tea«3&5*>e>3&*C«) 
»ftfe^^BBA*^H§^v^fttcj|*T bfe»*& 
K»»ffl»»a»«:jB»U ff»E»«S*fta»3&5xftSr* 
3teofcfc:«>U:lfrT bfc»-&lcA»«**a«BS:jBtfcU 

mrE»te*aaffl3&5*> & a> b£>$:£> fe*irfc*^*r»Bi b/t 

fc»^l»TUfc»*lcs»tlrtWfti*«*rjBllr1-6, 
*TA4fcU:ttr£#^S£E1&r3r ££4#^£ U 

mEfT»*«p**ic*$»ta»««ia««:, semm 

J; otAfttM bfc £ # lcmEA4fe««Ett#ACr# 
HRb-CE*SttTV^«ttAft<o»iR*«:», ME»je!5* 

9*tH**i,attA»*-C«>ffi«ttL 2trft. L 
1 > L 2-C*>«£#|c »*y HfcA*M»&it£H\ Ll 
< L 2-C*>St*fci2sB J x hSrAWlcifi^t, lWE*7* 
Hft3M&U: «fc 9 bfc £ * (CRM bfc»ffi fc A 

A*«^»w^aa5§: * u, 

*tEA»*i«Wrtel»fi, S9EA**«E«W^E« 

*^^*cv^*A*fll«t#fl8bT, mB*M#n«iai#iR 

«bTftfio^E*^^A«fcii^lftlcJ:-5ai*5:^EA^ 
*«E«Wd»6>H'JB»U #JE««**ttt*«lcj:*m^ 
* ; ffi»#ffi-TS fc tlc*fc*rbv^ffi*^fS:ggbrteo5 
*tfEBS»*m^«lc J: « WAS:(»EA*flMRE*»A» 

&mi»u ME*«»aj*«icj:5a*d5=tt«#«£-rs 
£ * i>^t bv^fctj^j/^rtt b*c m offjE«tt« a ^ 

«KiJ:*MA4rt»EAA*«E*»^feBfl|»rar i 4: 

bo 

loooi] 



[ 0 0 0 2 J 

KfS ur &> 6> ^ ^ * ^ ^ £ tiftrnvt* *to ft <o , 

I 0 0 0 3 J 

ta^^^r— > 3 yjtyi:^ ^©A^^o< >fe 

•^rtC^SA^Sr&fciJ U -fcOAWasffrC**** 
feBWUU *®A%*#*n?*3fca^^;te* 

[0 0 0 4 ] ^iii, res* 5 ftjft&fc^-CftSftfc 
5 4*E**tv^fl;»u AM* s «iB«*«D*r.i:a5-c 

[ 0 0 0 5 J 

[««4r#ftt5fc«>©¥a] f»**ltc:la«t4>3B9] 
tt\ ®f£A;b£S©£:, ttlHBAAKWcj; 9 A*£;ft/!: 
M»**&AttfcfcarSA*»ffl*«i:, ^A^i«W# 
Ki-i 9*W*^A**^OBE«*»HJi-$ffiW*a 
mteA»*a*«K:j:0*ffl*nfcA»*r>ISiJ 
r^A»«SU^«t, A*0*««rE«^-«A*HMRlB 

*kttW^*fc» lHBA**U*«^J;9*a4JLfcA» 



ttAA**IB««IC|B«*ftTV^*A*«*4r#Bab, 
^lBA*«ffi#SlcJ:*?A^d s «aJ*ix^»^^P> 

few ic(w»»«* * 9 mm&mm $ 
icia«*tLrti^-6A*fli«*#fiau ^itPt^b 

ttitSfrtttbvtfy b4rtt*rpj^fpi^, lWlBA4tofctiJ#« 
0 A<fea s *tti S i: *> 6*^ fc^/5i3# 

IBA»*«*W*^ftv^»^lc»Ti-*A««5Rto3a» 
k, ffllaAA«aia««t|5«*JxXv^«AAffM«Sr# 
BU McfitjfEA4^ffi#&lcJ; B&fii LTV>£ 

A»«>arfl*:fli*** SUlaJEgt^W^Slcj; ^^fctJ^H 
fcA^**COffig|^fo^A*D*«fc^^>^fiIJ; b 

< t>>^>munm^^m^mcx 9 A^x-^m^mn^o 

aq*W*fr*v^i:#lcA4t^aKfiU i!ut2^iita>&>(ba> 
kfrtf: fit J; 19 fc/hSVNt *^*j6Srjf:«>, fltflE 
*J*BB#«KlJ: *»J**B»LjM»^U:B»"Lfc : 8 1 Jir 

•a«bfc»*^wEA»«*ia«^«»cia«*jLXv^* 

WEA*©*«l*:#H>bX*A»»CJ«DfcK»ftU ffl 

ffiAWtAjfeo^^ftfer^^fcfe^c***^^^* 

Mb, n « 2/ h dSjSKi * Hfc t ^ i^AtrG^tbttiJffiijt&an 
Sr^l&L, K^S6*J»^^W8EA^ffi^lfelcj:*9 

lei b^^^kfitJia^M^W^StcJ: ^j^TUfc 
»^^A»«*«31*4:fi»b, ttA4toASR«L3«B^m 
EA««a**|c i 9 A«a65«ttt **Lfefc*|c*T b^: 
*«lc»B«S«BfrJStbU MBA4feB3RMaB«s*>6 
a*C*8fc» &*t^»MA*36 i 3»ai**T,*v>fc«>lc»lT U 
fe»-&lc»»*W»«ka»Srfi»u, fnC#BttBB^A 
»*a*ofcfc»»c*T bfc»*»cA»«*»a»*jB 
Me«rBA9B^ft>&^D«ft«)&ft^*i^»B 

r. t «r«*fcr k^6*s r t %&mkT 

I 0 0 0 6 ] IS*Jg 2 ^tBtto^^tt, StJlBA^'W^fE 
tt¥tt#, *BlB«rttKJD*.rA»lc#i-S#««S:E« 



TOiEfBffl: L 2 Sr#, L 1 > L 2 ~C&> %> b \£ & 3$ y h 
4rA4fca**>3S;*H\ LKL2tfc5^l:o#5/h4: 

[0 0 0 7 ] »*il3lClB«OSiWf± % mcffi 

Wla«fi«^Dx.-CA*flJ*jW«f*!i3a«B*r* 

[0 0 0 8 ] **8WUl«3B*fT»«*5> hOffttMW 
R«H\ »tt«Jffii«2i9, A«fMi, »B*k«i:r.;fc 

jilt, -<^h^L< gftnc^-rar t &$#^k-r 

[0 0 0 9] 

J: *3»»BK:R9ii-5. Ill m*»W^tt5 i*ff«ioaR 
Sggf»W^g3. A*KWK*4* A*««lBflnB5. 

* 1 1 , f?uw«i«s i 2, m%*-? 1 3 , HSB^- 

* 1 4 , »J*ffiAStt 1 5 ^tt5 0 

[ooio] MAA8Iitt^fi'**>?iftot 

«, w*©*>9©iir«*sg[iBjita»«3^A**n 

5„ A4fc«tiJ38a2-CW:, Wfcte3llcj;oTA*a s teW 



*<> A«*ttHJUfck*»ca:«fflS:«-f-ft#*ff»«l«i 
KSl 2^ffl*U A***ifeofci:#^W:Ajfeo^r. 
kSr^rft#?rtfa»Jffli^Sl 2-tti^-r^>o A 

ft^w^e 2 aw*-*- * \mv>&<7>m& i<ott«flMHr± 

A%»ffiSg«2-caiij*n3tifi^*ttigfitffm^s 
3 i A««»m«4— «ie*fts. 

[ooii] S§Bfgfctj£ig3-Cte, ^t^-r^v^ 

«*ms6S3 fT»wj»i6«i 2^&#flR*r 

6It^«tftotV^. A»«»JiS«4-Ctf\ A#3 
^S«l5^Sffl5^c|H«$tl,rv^^Aft^>lfiMlfto^S?RS^# 
IU, »W*H^A*^«»*nyhA«o5feoii-c 
^/t^^gL^HTV^^v^A^-Cfe^A^^B'J^ 

i&£ft5 0 

[0 0 1 2] *FA*3SS6 tt#^-f ictti* fcftfcHo 
* S ft* ^^Ei^>r^oAAi 5 $ 

^»8fi8^«l6*ns 0 f^»KB8tli, A* 

3o t?A*Ki 6 ^ OAA^fH 

H\ *«o^*teJ;*#F»*fcW« tt, -to**? 

[0013] ^t9tta/f^ ^ttlftfe^tC^ 

g£ft, *ott;btti*e*ttHttMl o^flMeSft** 

HtS4fetftHj£Eflti 0^{«Wr^EIB1ft«»fTtblH«i 
^® 1 2^fc#H81"<5 r. kfr*jmxfrZ> 0 <? y^^^ 
Hit a#y h<Z>mmcm&£ft, ^V>* y?*^ 

£ *«*4rfr«i*J»»Ml 2^«*&-r*. 

^„ fT8&ft"Jffll^«l 2H\ W]«j5ai^2 i, Afe« 
**aa«5 2 2 , ^BfcifflSB 2 3 , W»«J#«2 4, A^? 
ffifflK«a5 2 Sk^feft*. AAfl»«R|B1ft«P2 5\cn, 
Aft*a»«2, A*MUMB4 1 V9K#i4ttttRB 

1M i^fetT»<W«i8«i 2^a**ft**«^«Uc|B 



1 



[0015] temmmfcrnw 2 1 , A®>mmtemw 2 

#P£fl^-* 1 3 , BMB* — # 1 4 , ^fctj^g 1 5 — 

Bit * *vt v ^ « £ fTftMftSSMft* & fc£ A* mn b 

[0016]^ *^KKfl^fl&cofT »#J»SSe 1 2 <DKj 

^i&H^^ro ifli^l:, 9tl»*M2i|io 
v>Ti2^#iLTl^ 0 MiMl«2iN: % 
8 2l^tJ: SKA'—:/ (fftGiSD *&a*fr9. A— 
AA**#HB«2 1 1 2:fHftitt31«2 
1 2i^fcti, A*W«#Bg»2 1 iTttA*fflf«IBtB 
95 2 5 ^ffi«*^*C V> 5 A*'IS$S^ 5 *><Dfc o £ fcl^ 

•fS^^5i«9 ai brr^^$ij{ip*n : ji^2 1 2— 8rt% 

l 3*5«fctfSI«*— * 1 4 — t) x mc. A* 

ttw««a«s 2 1 i±MTt^ e 
[001 7 1 ei t »*aaw 2 1 2 <^»f^ a#wic 

»-S\ WW* — * 1 3 fcfflh^SraS*. P^W%) 
^#ft^5;frfifci£o#fi«r|S]< J; 1 3 

u:**4:asa. r<z>t #^0:^— ^AatMsn-a. aa 

i$f^£ri£*K ^coL^^T^^nxK-/ hSrfttf, A*— 
a£ri£tt£ 0 A****** y^-fc VIM 1 £>fcti;ft*r£>$ 
fc^tUi, *fc-ce>^^^Pn*»K^:^^H*3e>r> A'— 7 

*a4ra»ta. A*«*a«i:fB«#<&»-fr <a;**** s 

[0018] A4ftffi*#lJS«B 2 2 OftflMCOV^ 

A«s^ia 2 2 n^tdsijateiiB 2 1 1 

^-/MA^/^ 0 A'— ~7f&m<0*P\C\Z, A 

a««#sb«2 1 1 kmm&mw2 12^^^ 

2 1 1 TttAAtt*E**2 5lCtettSftT 

H*»j»*aai«5 2 1 2^«-j% «j»«ksffi2 1 2xn, 

«*^A*««lcj«lS^:-ft^«rttl»*-* a 3*?J:t* 

14^^ AJjisfrMnma&tx, A*- 

So 



[0019] 0Ti:««wa« 212 <oifrf£* jy*wtc 

^P^tSo A*'»fffi^Afe^tli^a2^tii*-Cfc«9, 
ort**5A«5«Wca>«»-&, A/-^S:S^« 0 A2M* 

£«> ^<oh tfcrtA'— ^«iatra»tftv\ A*f**± 
*aa« 2 2 36Sjgi(iSft-c**fe©w?iaiSr^* u r<^> 

[0020] ^fgfe3sa5 2 3 (ommc^^xmm 
^gfea« 2 3 K&tbfHfflittiasis 2 1 1 i^^tc, 

A*T»«#fH«2 1 1 £ ^JtJU&SS 2 1 2fc^fe«fi)t* 
*t*A^— ^*aiCftoTV^«. AMffi#I%2 1 IT 
W:A*««ia«SB 2 5 tCiaS&ftt V^A*fS$RO 5 % 
<^fcofc fcftvHMMrfiOHLT rtt«r1M«l«til«B2 1 

2^aM-. M»tea»2i 2-ctt, **afcA*flwaic 

iSCfe***Hl«B*- i 3*5j;u<sraBq&— * l 4*5 J: 

A'— ^«a*a*ts*»A^— ^*at»t**»o*j>frtfT 

5. A'— »fS*&3ffi«2 3l±j»T-r 
[0 0 2 1 ] @LTICMfPA9« 2 l 2<0»f^*J|ft:W|c 

UiPJ^^o A**«3&5A4*ttW8«2oai*-c*>9, * 

^oT4S£r6K, ftifds^*.e>n* (rc5^^tci±A* 
<rAA9 0-c#liAa«2 3M:MT a f-«r:2:lcft«) 0 
wOfcSA*— ^"ttHtJt&V^ BWUfemiS^j,^ 

[0022] ^ftC^AMVJSt 4 ©ffl*tfcfi i 
t^tt»8UJB*fc«WUTA^— ^»a*ife»t*V\ A* 
»fli«WgSl 0Ott}*-c^6i:#lC»in^i/ 

h*#jh**aa^ a^— ^jaattftjtftv^ aaaubj&s 
tit ^tF^tti*8s i 5a»e>tb* 

U A*?* 5 •^SU■C#■CV^5^:#^cW:-tcDA*o»lBftS^ 

tt^OA«5O»^SSr«^*-fr^ 0 A*««j&5jtgB£ji^ 
(A**** s ffio#^t^tf) Cli, Afe^ffiSS 
*2lciR»*ftTV^*Afeoe^^^oB«Jbo<fi[HJffi 



[0 0 2 3] mexp ^tirg^pjfift^4»,L^t>— ^ 

fS^tfC, MC^O. 3 *9t-C*>;h,tf L a , 0. 3 
£*_L0. 7*|tfchtfLb, 0. 7BUbT*>fttfL c 
(La>Lb>Lc) cD<t 5 Ulfc 6>J&»C*R5tS jK/CI^ 
5o *lCffiK#a»«3lC«i»*HTV>*A**-COE 
««L2 4r*»U L 2>L lTfcittfd^jy h 

[0 0 2 4 ] 9C^W«I9J*«B 2 4 £>S>mC0V>Ti&^r 
2 4 fct, hjftSjgft^^yv. 

W2lis, A**r*fflb-Cj»TUfe»'ft'lctt»IS*aa« 
teTbfc:»£\ Aft«*#LSW 2 2 A$3l£ 

^MS2 2^ A^j^^tbbx^r u^ii'S'ictt^te 

*13*5 2 3 SriBftU *>fe^C«>*«)e>^»H|J: 5 <> 
fiV>i^ 5 T Ufe»-&jCtt»tt«IJ»«l3ffiSB2 1 

SriSIfcrSo ttfiMaSffl 2 3 i6S, Aft^Mct^Tl 
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